A Q-Learning-Based Approach for Simple and Multi-Agent Systems

This study proposes different machine learning-based solutions to both single and multi-agent systems, took place on a 2-D simulation platform, namely, Robocode. This dynamic and programmable platform allows agents to interact with the environment and each other by employing a variety of battling strategies. Q-Learning is one of the leading and popular machine learning-based solutions to be applied to such a problem. However, especially for continued spaces, the control problem gets deeper. Essentially, one of the main drawbacks of reinforcement learning (RL) is to design an appropriate reward function that the function can be described by only employing few parameters for simple tasks, whereas estimating the goal of the reward function may be a challenging problem. Recent studies prove that neural network-based approaches can handle these challenges and achieve to learn control strategies from 2-D or 1-D data. Besides those problems of RL algorithms for single robots, once the number of robots increases and the systems need to behave as multi-agent systems, the overall design requirements become more complex. Accordingly, the proposed system is validated by considering different battle scenarios. The performance of the Q-Learning-based system and the supervised learning techniques are compared by employing different scenarios for this problem. Results reveal the superiority of the ANN-based approach over other methods

Multiagent Systems for 3D Reconstruction Applications

3D models of scenes are used in many areas ranging from cultural heritage to video games. In order to model a scene, there are several techniques. One of the well-known and well-used techniques is image-based reconstruction. An image-based reconstruction starts with data acquisition step and ends with 3D model of the scene. Data are collected from the scene using various ways. The chapter explains how data acquisition step can be handled using a multiagent system. The explanation is provided by literature reviews and a study whose purpose is reconstructing an area in 3D using a multiagent UAV system

Recoil analysis for heavy Ion beams

Given that there are 94 clinics and more than 200,000 patients treated worldwide, proton and carbon are the most used heavily charged particles in heavy-ion (HI) therapy. However, there is a recent increasing trend in using new ion beams. Each HI has a different effect on the target. As each HI moves through the tissue, they lose enormous energy in collisions, so their range is not long. Ionization accounts for the majority of this loss in energy. During this interaction of the heavily charged particles with the target, the particles do not only ionize but also lose energy with the recoil. Recoil occurs by atom-to-atom collisions. With these collisions, crystalline atoms react with different combinations and form cascades in accordance with their energies. Thus, secondary particles create ionization and recoil. In this study, recoil values of Boron(B), Carbon(C), Nitrogen(N), and Oxygen(O) beams in the water phantom were computed in the energy range of 2.0-2.5 GeV using Monte Carlo simulation and the results were compared with carbon. Our findings have shown that C beams have 35.3% more recoil range than B beams, while it has 14.5% and 118.7% less recoil range than N and O beams, respectively. The recoil peak amplitude of C beams is 68.1% more than B beams, while it is 13.1% less than N and 22.9% less than O beams. It was observed that there is a regular increase in the recoil peak amplitude for C and B ions, unlike O and N where such a regularity could not be seen. Moreover, the gaps in the crystal structure increased as the energy increases

A novel framework using deep auto-encoders based linear model for data classification

This paper proposes a novel data classification framework, combining sparse auto-encoders (SAEs) and a post-processing system consisting of a linear system model relying on Particle Swarm Optimization (PSO) algorithm. All the sensitive and high-level features are extracted by using the first auto-encoder which is wired to the second auto-encoder, followed by a Softmax function layer to classify the extracted features obtained from the second layer. The two auto-encoders and the Softmax classifier are stacked in order to be trained in a supervised approach using the well-known backpropagation algorithm to enhance the performance of the neural network. Afterwards, the linear model transforms the calculated output of the deep stacked sparse auto-encoder to a value close to the anticipated output. This simple transformation increases the overall data classification performance of the stacked sparse auto-encoder architecture. The PSO algorithm allows the estimation of the parameters of the linear model in a metaheuristic policy. The proposed framework is validated by using three public datasets, which present promising results when compared with the current literature. Furthermore, the framework can be applied to any data classification problem by considering minor updates such as altering some parameters including input features, hidden neurons and output classes. Keywords: deep sparse auto-encoders, medical diagnosis, linear model, data classification, PSO algorithmpublishedVersio

A Goal Oriented Navigation System Using Vision

This paper addresses a goal oriented navigation framework in a behavior-based manner for autonomous systems. The framework is mainly designed based on a behavioral architecture and relies on a monocular vision camera to obtain the location of goal. The framework employs a virt ual physic based method to steer the robot towards the goal while avoiding unknown obstacles, located along its path. Simulation results validate the performance of the proposed framework

Machine Learning Applications in Dentistry

Artificial Intelligence has emerged as a breakthrough in many fields including medicine and dentistry where new approaches can be employed to solve challenging decision making processes faced in the dental field. Artificial intelligence can be used as a decision support mechanism to solve the increasing population and consequently the increasing dental treatment needs. It also assists dentists in diagnosis and treatment planning stages that require expert opinion. This mini-review covers some of the recent studies in this area and envisions future directions on the use of machine learning in dental problems

A Hybrid Feature Extractor using Fast Hessian Detector and SIFT

This paper addresses a new hybrid feature extractor algorithm, which in essence integrates a Fast-Hessian detector into the SIFT (Scale Invariant Feature Transform) algorithm. Feature extractors mainly consist of two essential parts: feature detector and descriptor extractor. This study proposes to integrate (Speeded-Up Robust Features) SURF’s hessian detector into the SIFT algorithm so as to boost the total number of true matched pairs. This is a critical requirement in image processing and widely used in various corresponding fields from image stitching to object recognition. The proposed hybrid algorithm has been tested under different experimental conditions and results are quite encouraging in terms of obtaining higher matched pairs and precision score

A Hybrid Architecture for Vision-Based Obstacle Avoidance

This paper proposes a new obstacle avoidance method using a single monocular vision camera as the only sensor which is called as Hybrid Architecture. This architecture integrates a high performance appearance-based obstacle detection method into an optical flow-based navigation system. The hybrid architecture was designed and implemented to run both methods simultaneously and is able to combine the results of each method using a novel arbitration mechanism. The proposed strategy successfully fused two different vision-based obstacle avoidance methods using this arbitration mechanism in order to permit a safer obstacle avoidance system. Accordingly, to establish the adequacy of the design of the obstacle avoidance system, a series of experiments were conducted. The results demonstrate the characteristics of the proposed architecture, and the results prove that its performance is somewhat better than the conventional optical flow-based architecture. Especially, the robot employing Hybrid Architecture avoids lateral obstacles in a more smooth and robust manner than when using the conventional optical flow-based technique

A Novel Hybrid Machine Learning Based System to Classify Shoulder Implant Manufacturers

It is necessary to know the manufacturer and model of a previously implanted shoulder prosthesis before performing Total Shoulder Arthroplasty operations, which may need to be performed repeatedly in accordance with the need for repair or replacement. In cases where the patient’s previous records cannot be found, where the records are not clear, or the surgery was conducted abroad, the specialist should identify the implant manufacturer and model during preoperative X-ray controls. In this study, an auxiliary expert system is proposed for classifying manufacturers of shoulder implants on the basis of X-ray images that is automated, objective, and based on hybrid machine learning models. In the proposed system, ten different hybrid models consisting of a combination of deep learning and machine learning algorithms were created and statistically tested. According to the experimental results, an accuracy of 95.07% was achieved using the DenseNet201 + Logistic Regression model, one of the proposed hybrid machine learning models (p < 0.05). The proposed hybrid machine learning algorithms achieve the goal of low cost and high performance compared to other studies in the literature. The results lead the authors to believe that the proposed system could be used in hospitals as an automatic and objective system for assisting orthopedists in the rapid and effective determination of shoulder implant types before performing revision surgery